Skip to content

Add Replicator kitchen example assets and yamls - #965

Merged
qianl-nv merged 1 commit into
mainfrom
qianl/feature/replicator-example
Aug 5, 2026
Merged

Add Replicator kitchen example assets and yamls#965
qianl-nv merged 1 commit into
mainfrom
qianl/feature/replicator-example

Conversation

@qianl-nv

@qianl-nv qianl-nv commented Jul 28, 2026

Copy link
Copy Markdown
Collaborator

Summary

Add Replicator kitchen environments

Detailed description

  • Register five hosted Replicator kitchen backgrounds using a staging server version to unblock internal development, while we awaits the production server version to be uploaded.
  • Add 14 kitchen pick-and-place YAML configurations.
  • Use mesh collision for background placement.
  • New yamls are protected by existing test_kitchen_bench_yaml_env.py test.

/isaac-sim/python.sh isaaclab_arena/evaluation/policy_runner.py --viz kit --policy_type zero_action --num_episodes 20 --disable_fabric --device cpu --env_graph_spec_yaml isaaclab_arena_environments/kitchen_bench/replicator_kitchen_peninsula_mustard_bowl.yaml

penisula_mustard_mesh_short

@qianl-nv
qianl-nv force-pushed the qianl/feature/replicator-example branch 2 times, most recently from 48f8ac8 to 6963e92 Compare August 3, 2026 09:17
@qianl-nv
qianl-nv changed the base branch from main to qianl/feature/mesh-collision-deduplication August 3, 2026 09:18
Base automatically changed from qianl/feature/mesh-collision-deduplication to main August 4, 2026 06:37
@qianl-nv
qianl-nv force-pushed the qianl/feature/replicator-example branch from 6963e92 to 9da8aef Compare August 4, 2026 07:59
@qianl-nv qianl-nv changed the title Add Replicator kitchen example assets Add Replicator kitchen example assets and yamls Aug 5, 2026
@qianl-nv
qianl-nv force-pushed the qianl/feature/replicator-example branch from 9da8aef to ea02914 Compare August 5, 2026 03:01
@qianl-nv
qianl-nv marked this pull request as ready for review August 5, 2026 03:01
@greptile-apps

greptile-apps Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

The PR adds five hosted Replicator kitchen backgrounds and fourteen DROID pick-and-place environment specifications.

  • Registers G-shape, L-island, L-shape, peninsula, and U-shape kitchen assets.
  • Configures mesh-based background collision and fixed kitchen-surface references.
  • Adds banana-to-bowl, mustard-to-bowl, and bowl-to-sink task variants across the available layouts.

Confidence Score: 5/5

The PR appears safe to merge with no concrete changed-code defects identified.

The new backgrounds follow the existing registry and constructor contracts, and the environment specifications use valid registered assets, relation shapes, node references, and pick-and-place task parameters.

Important Files Changed

Filename Overview
isaaclab_arena/assets/background_library.py Registers five Replicator kitchen backgrounds with hosted USD paths, identity poses, and a shared viewer configuration.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_g_shape_banana_bowl.yaml Adds a schema-consistent banana-to-bowl task using the G-shaped kitchen corner counter.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_g_shape_bowl_sink.yaml Adds a bowl-to-sink task with valid sink and counter references for the G-shaped layout.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_g_shape_mustard_bowl.yaml Adds a mustard-to-bowl task on the G-shaped kitchen island.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_l_island_banana_bowl.yaml Adds a banana-to-bowl task using the L-island corner counter.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_l_island_bowl_sink.yaml Adds a bowl-to-sink task for the L-island layout.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_l_island_mustard_bowl.yaml Adds a mustard-to-bowl task on the L-island work surface.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_l_shape_banana_bowl.yaml Adds a banana-to-bowl task using the L-shaped kitchen corner counter.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_l_shape_bowl_sink.yaml Adds a bowl-to-sink task for the L-shaped layout.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_l_shape_mustard_bowl.yaml Adds a mustard-to-bowl task on the L-shaped kitchen counter.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_peninsula_bowl_sink.yaml Adds a bowl-to-sink task for the peninsula layout.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_peninsula_mustard_bowl.yaml Adds a mustard-to-bowl task on the peninsula counter.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_u_shape_banana_bowl.yaml Adds a banana-to-bowl task using the U-shaped kitchen corner counter.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_u_shape_bowl_sink.yaml Adds a bowl-to-sink task for the U-shaped layout.
isaaclab_arena_environments/kitchen_bench/replicator_kitchen_u_shape_mustard_bowl.yaml Adds a mustard-to-bowl task on the U-shaped kitchen counter.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  YAML[Kitchen environment YAML] --> Registry[Asset registry]
  Registry --> Background[Replicator kitchen background]
  YAML --> References[Floor, counter, and sink references]
  Background --> References
  References --> Solver[Relation and mesh-collision placement]
  YAML --> Task[PickAndPlaceTask]
  Solver --> Environment[Runnable IsaacLab environment]
  Task --> Environment
Loading

Reviews (1): Last reviewed commit: "Add Replicator kitchen environments" | Re-trigger Greptile

@arena-review-bot

Copy link
Copy Markdown
Contributor

🤖 Isaac Lab-Arena Review Bot

Summary

This PR registers five hosted Replicator kitchen backgrounds in background_library.py and adds 14 pick-and-place env YAMLs under kitchen_bench/. It is almost entirely declarative data: the new background classes cleanly follow the existing LibraryBackground pattern, and the YAMLs mirror the established droid_pick_and_place_lightwheel_kitchen.yaml shape. No boundary, layering, or silent-failure concerns. Copyright years are correct (new YAMLs carry 2026; the touched background_library.py header stays 2025-2026).

Findings

🟡 Warning: replicator_kitchen_*_banana_bowl.yaml — The four banana_bowl configs are byte-identical except env_name and the kitchen registry_name; they place the banana on CornerCounter_00_0 with the same relation params across four differently-shaped kitchens. The mustard and bowl_sink variants were tuned per kitchen, so this stands out — worth confirming the placement is valid in all four layouts, and (if so) whether these could be generated from one template to avoid silent drift. (Inline.)

Test Coverage

No new code paths — these are data configs consumed by the existing env builder. Good news: tests/test_kitchen_bench_yaml_env.py globs kitchen_bench/*.yaml and parametrizes a build-and-reset sim bring-up over every file, so all 14 new YAMLs are automatically exercised (parse → build → reset, asserting the robot is in the scene). That test is the right safety net for bad prim paths or broken relations; just make sure it runs green in the sim phase for this branch, since the PR-level CI here only covers pre-commit/uv.

Verdict

Ship it — one optional consistency question on the banana_bowl set.

Comment thread isaaclab_arena/assets/background_library.py Outdated
Register five hosted Replicator kitchen backgrounds and add their
pick-and-place environment configurations.

Signed-off-by: Qian Lin <qianl@nvidia.com>
@qianl-nv
qianl-nv force-pushed the qianl/feature/replicator-example branch from ea02914 to fae09d1 Compare August 5, 2026 07:16

@alexmillane alexmillane left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Amazing!

Out of interest does kitchen_bench refer to that things happen on the bench, or that this is a benchmark. Or is that play on words the point.

Great! Let's run it on OSMO!

@qianl-nv
qianl-nv merged commit 7095abf into main Aug 5, 2026
10 checks passed
@qianl-nv
qianl-nv deleted the qianl/feature/replicator-example branch August 5, 2026 16:57
@qianl-nv

qianl-nv commented Aug 5, 2026

Copy link
Copy Markdown
Collaborator Author

It's not a full benchmark yet, so we are half way there with "bench"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants